Managing and collaborating with digital content

ABSTRACT

A universal digital content system provides a dynamic user interface having a viewing area, an action menu area, and an organizing area. A user can create, organize, send, receive, access, collaborate with and otherwise manage digital content through a single user interface. The universal digital content system provides multiple ways of viewing and organizing all of the digital content accessible through the dynamic user interface. In addition, a user can create a collaboration session with one or more contacts using one or more digital content files.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. application Ser. No.12/728,845 filed on Mar. 22, 2010, which is a continuation of U.S.application Ser. No. 11/170,859 filed on Jun. 30, 2005 which is nowissued as U.S. Pat. No. 7,689,655, which is a continuation in part ofU.S. application Ser. No. 11/005,348 filed on Dec. 6, 2004. Each of theaforementioned patent(s), and application(s) are hereby incorporated byreference in their entirety.

BACKGROUND OF THE INVENTION

1. The Field of the Invention

The present invention relates to systems and methods for organizingdigital content and collaborating with digital content using a universaldigital content system having a dynamic user interface.

2. The Relevant Technology

The electronic age has revolutionized the way in which peoplecommunicate. In many cases, paper and other visual media have beenreplaced by digital content, such as electronic text documents such asword processing documents, electronic notes, electronic journalsentries, electronic messages, instant messages, text messages, and thelike, or other multimedia content such as digital photos, audio files,and video files. However, people continue to use digital content in muchthe same way that conventional visual media are used—to send messages toother people, to maintain lists for organizational purposes, to keepjournals, to maintain electronic photo albums, to view television and/ormovie clips, and the like.

Various software applications have been developed to enable people tocontinue to use digital content for these various purposes. For example,electronic messaging software has become a primary means for people tosend text-based electronic messages to each other. Instant messaging andtext messaging have developed as alternative ways to send text-basedelectronic messages. Various organizational information softwareapplications have been developed to assist people in organizing personalcontact, calendar, journal, and task information. Other applicationshave developed for other multi-media digital content such as digitalphoto software, multi-media players, and the like.

However, having to switch between multiple applications that arespecifically designed for one or only a few types of digital content, istime consuming for a user. Furthermore, it can be difficult for a userto remember where a certain file is saved. Or, if a file was deliveredto the user, the user may have a hard time remembering who sent the fileor where it is located. Further, where users may communicate by multiplemessaging systems, e.g., by electronic messaging and instant messaging,viewing past emails or instant messages may not provide a completerepresentation of the overall conversation in which the multiplemessages took place. Thus, the user must consult stored files in bothapplications to reconstruct the pieces and the chronology of theconversation. In some cases, some instant messaging applications do notstore a conversation at all. Rather than go through the trouble ofreconstructing conversations, a user will usually rely on her memory.

BRIEF SUMMARY OF THE INVENTION

These and other limitations are overcome by embodiments of the presentinvention, which relate to systems and methods for organizing andcollaborating with digital content using a universal digital contentsystem having a dynamic user interface. One embodiment of the presentinvention allows a user to generate a digital content file and select anaction for the digital content file without having to commit beforehandto the type of action. The dynamic user interface is initially generic,but then can morph and adapt depending on the type of digital contentfile being created and/or the action selected. The network status ofpotential recipients of the digital content file may be monitored inorder to assist a user in selecting a particular action for the digitalcontent file. Thus, a user can seamlessly switch from one application toanother through the same dynamic user interface.

In another embodiment, the user can access messages through the dynamicuser interface. Conventionally, users had to receive different types ofelectronic messages using specific applications for that type ofmessage. The universal digital content system simplifies the process ofreceiving messages by providing a single user interface through which auser can access messages. The dynamic user interface will morphdepending on the type of electronic message being accessed. Further,because the user could be inundated with numerous messages at sometimesinconvenient times, a user can specify the method of delivery ofmessages (e.g., send instant messages as emails) and times at whichcertain delivery methods will be available. In addition, a user couldallow incoming messages from certain people to be passed through to thedynamic user interface while notifications of messages from other peopleare withheld until the user accesses a messaging application through thedynamic user interface.

Another embodiment of the invention relates to the organization ofdigital content that is created or otherwise accessed by the user viathe universal digital content system. When digital content is created orreceived through the universal digital content system, it is stored andorganized in a storage device so that it is searchable by many differentcriteria or categories and in ways that digital content has not beensearchable before. Digital content can also be imported to the universaldigital content system from a local or remote location. Each type ofdigital content could be organized according to conventional ways ofsorting various types of digital content, such as, but not limited to,type of digital content, author, subject, date received or sent,conversation, and the like.

In addition, a global view can be provided that combines all of thedigital content to which the universal digital content system has accessto be sorted according to various criteria. The digital content can beorganized by combining messages from any sender using any messagingmethod, author, date, type of digital content, conversation, and thelike. Conversations relate to two or more digital content files that areelectronically linked together using hyperlinking, replying, forwarding,collaborating, and the like, into distinct conversations allowing a userto view the history of a conversation. The user can further view anyconversation involving a particular piece of digital content.

Another embodiment relates to providing collaborating features using thedynamic user interface of the present invention. The universal digitalcontent system keeps track of digital content that is linked togetherand specific places where content from one file might be linked tocontent in another file. As an example, a user can highlight a sectionin an email, select to collaborate to the email, and the highlightedsection is included in a collaboration message. The collaborationmessage can be sent by any messaging means. A user can then click on thehighlighted section in the collaboration message which will act as ahyperlink to the referenced digital file. This dynamic content linkingcan be facilitated by the dynamic user interface morphing between thereferenced digital content (i.e., email) and the reply digital content(i.e., instant message). The collaboration feature can be extended tomultiple referenced files and multiple collaborators.

These and other features of the present invention will become more fullyapparent from the following description and appended claims, or may belearned by the practice of the invention as set forth hereinafter.

BRIEF DESCRIPTION OF THE DRAWINGS

To further clarify the above and other features of the presentinvention, a more particular description of the invention will berendered by reference to specific embodiments thereof which areillustrated in the appended drawings. It is appreciated that thesedrawings depict only typical embodiments of the invention and aretherefore not to be considered limiting of its scope. The invention willbe described and explained with additional specificity and detailthrough the use of the accompanying drawings in which:

FIG. 1A through 1C illustrate an exemplary dynamic user interfacedisplaying various features according to embodiments of the presentinvention;

FIGS. 2A through 2B illustrate exemplary ways of organizing digitalcontent on the dynamic user interface; and

FIG. 3 shows an exemplary network system containing the universaldigital content system according to embodiments of the presentinvention.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Generally, the present invention relates to a universal digital contentsystem that includes a dynamic user interface for creating, organizing,sending, receiving, accessing, collaborating with and otherwise managingdigital content. The universal digital content system of the presentinvention is similar to the multipurpose text application disclosed inco-pending U.S. patent application Ser. No. 11/005,348, filed Dec. 6,2004, the disclosure of which is incorporated herein by reference in itsentirety. However, the universal digital content system containsadditional features in addition to those associated with themultipurpose text application.

As used herein, the term “digital content” refers to an electronic filethat contains visual or audio content. Digital content can be text filesin various forms such as, but not limited to, word processing files,email messaging files, text messaging files, instant messaging files,and the like. Such text files can also include image content or audiocontent embedded therein or attached thereto. Digital content caninclude image files or movie files, and the like. Digital content canalso include audio content such as voice messaging files, movie filesthat contain audio content, music files or other sound files, and thelike.

With reference to FIG. 1A, a dynamic user interface 100 associated witha universal digital content system (see FIG. 3) is depicted toillustrate the versatile nature of the universal digital content system.Other components of the universal digital content system in addition tothe dynamic user interface will be described with reference to FIG. 3.The dynamic user interface 100 is a generally small, fast user interfacewhich provides various interface areas, referred to generally as aviewing area 101A, action menu area 101B, and organizing area 101C. Theinterface areas 101A through 101C can operate co-dependently orindependently of each other. The division of the dynamic user interface100 into these general areas is provided only for purposes of describingthe present invention. It should be understood that components orfunctionalities from one interface area 101A through 101C of the dynamicuser interface 100 may be duplicated, modified, overlap or be moved intoanother interface area of the dynamic user interface depending on designconsiderations. Further, other functionalities for each interface area101A through 101C in addition to the ones described herein may also beincluded within the spirit of the teachings of the present invention.

Viewing area 101A includes a generic viewing screen 102 for formattingvarious types of digital content. In one embodiment, viewing screen 102appears as a blank template when first opened and allows a user to inputany digital content such as text, graphical representations, images,sound, and the like. Thus, the viewing screen 102 may also havemaximizing, minimizing and scrolling capabilities if the user wants tochange the viewing capabilities of the viewing screen, such as when theuser wants to create a lengthy text document. Although not shown,various means for inputting digital content into the viewing screen 102can be used, such as, but not limited to, a keyboard, a mouse, a stylusor other pointer (where the viewing screen is pressure sensitive), ajoystick, audio hardware and software (e.g., microphone), and imaginghardware and software (e.g., camera hardware and/or software), and thelike, whether directly or remotely connected.

As illustrated in FIG. 1A, viewing screen 102 may also initially displaybrief instructions to a user to indicate that any of the selectionscontained in action menu area 101B (discussed below) can be selectedeven before a digital content file is generated. When a user selects aparticular type of digital content to create, the viewing screen 102will change to be more specific to that particular digital content. FIG.1B illustrates one embodiment in which the user has input digitalcontent into viewing screen 102 and decides to send the digital contentby email messaging. The viewing area 101A changes to include a messageviewing screen 102A (which may be original viewing screen 102) andheader fields 102B (e.g., TO, CC, BCC, and subject line) for allowingthe user to specify or view recipients, addresses, and/or subject linesof an electronic message being generated and/or managed.

With reference to FIG. 1C, suppose a user decides to send digitalcontent as an instant message. The user selects instant messageselection 105A from action menu area 101B. The viewing area 101A changesto provide fields that may be more suitable or conventional for managinginstant messages. For examples, as shown in FIG. 1C, viewing area 101Ahas changed to provide a message viewing screen 102A (which may beoriginal viewing screen 102) and an input screen 102C. Additionally,send selection 102D may be provided to initiate sending the text that isinput into screen 102B.

In addition, FIG. 1C illustrates viewing area 101A configured toaccommodate viewing multiple digital content. That is, an additionalviewing screen 102E and 102F are provided to enable viewing a second andthird digital content file. The viewing screen 102A overlaps viewingscreens 102E and 102F. Multiple viewing screens can also be accomplishedby forming a split view on one main viewing screen. As shown in FIG. 1C,the viewing screen 102A, 102E, 102F can have indicators 102G, 102H,102I, respectively (e.g., an icon or tab bar) that reflects the order inwhich the viewing screens were created. This can assist the user inremembering to what digital content each viewing screen relates.Indicators 102G, 102H, 102I can have descriptive text, different colors,icons that reflect what digital content type the viewing screen displays(e.g., collaboration file, referenced file), and the like. Each viewingscreen 102A, 102E, 102F may also include minimizing and maximizingfeatures. The ability to allow a user to view multiple digital contentfiles can be beneficial where a user is collaborating on a digitalcontent file, described further below. Thus, application-specificfeatures, such as input screens, header fields, and the like, aregenerally hidden in the initial presentation of viewing area 101A toavoid the appearance that the dynamic user interface 100 can be usedonly for certain types of digital content.

Turning back to FIG. 1A, viewing area 101A can also exemplarily includedigital content processing selections 103A through 103E that provide atleast basic functionalities that can apply to one or more types ofdigital content such as, but not limited to, opening existing digitalcontent files (selection 103A), cut and pasting digital content(selection 103B), and formatting functions (selection 103C) available inmost word processing and/or multimedia applications. The viewing area101A may also include the ability to attach objects such as text, image,audio, or movie attachments (selection 103D) in any digital format. Theviewing area 101A may also include printing capability (selection 103E).Further, the viewing area 101A may include audio/visual tools (selection103F) for generating and/or playing audio and/or visual content. Thedynamic user interface 100 can thus generally be used to create, access,or otherwise manage any digital content. The term “selection” refers toany graphical icon or button or menu item or indicator that can beselected by a user in order to access that functionality.

The selections 103A through 103F may include pull down menus whichprovide for additional selections that a user can select. Pop-updialogue windows may appear to allow a user to further navigate throughvarious selections for selections 103A through 103F, such as, but notlimited to, searching, browsing, formatting, attaching, printing, andaudio/visual selections. Further, viewing screen 102 could also be usedto provide dialogue windows for enabling these and other functions.

Turning now to action menu area 101B, a plurality of selections 104Athrough 104D provides general actions that can be taken related tomanaging digital content in the viewing area 101A. Operation of actionselections 104A through 104D may also require some interaction withviewing area 101A and/or organizing area 101C. Before, during or afterthe user creates digital content, the user can then select any of theaction selections 104A through 104D.

Exemplarily, as shown in FIG. 2A, deliver selection 104A causes actionmenu area 101B to change to provide various delivery mechanisms forhandling a digital content file created or otherwise accessed by a user.Any number of delivery mechanisms may be associated with deliverselection 104A such as, but not limited to, sending an instant message105A, sending an email message 105B, sending a text message 105C,sending a voice message 105D, creating an organizational informationentry 105E, performing collaboration 105G and saving a draft of thedigital content file 105G. Thus, by selecting one or more of thesedelivery mechanism selections 105A through 105G, the user is able toactivate the functions necessary to accomplish the selected action(s).It will be appreciated that other existing or future developed actionsfor handling digital content may be included in view of the teachingsherein.

As used in the present invention, the term “delivery mechanism” and“action” will sometimes be used interchangeably to refer to a potentialaction to be performed with a digital content file since selection of anaction menu selection 104A through 104D changes the dynamic userinterface 100 to provide the functions reflected in delivery mechanismselections 105A through 105G. The terms delivery mechanism and actionare broad enough to encompass delivering a digital content file to adatabase on the user's device or in a remote location, such as a remoteserver. Thus, storing a digital content file in a database can also beconsidered an action in accordance with the scope of the presentinvention.

When a delivery mechanism selection 105A through 105G is selected,either before, during or after the digital content file is created orotherwise accessed, the viewing area 101A can be modified as describedabove to display the information necessary to carry out the selectedaction. In some cases, for example in the email view (FIG. 1B) and theinstant messaging view (FIG. 1C), the user may be required to produceadditional information. The multi-purpose and adaptable nature of thedynamic user interface 100 thus provides a user with added freedom inmanaging various types of digital content such as, but not limited to,managing instant messages, email messages, text messages, voicemessages, organizational information, word processing documents, imagefiles, audio files, movie files, and the like, without having tonavigate through several different applications. Any of the selectionsin action menu area 101B can be selected at any time and the dynamicuser interface 100 will change corresponding to the user selection. Inaddition, the user may use the same digital content file for multiplepurposes using the same universal digital content system.

Collaboration selection 104B changes the action menu area 101B toprovide functionalities related to allowing a user to collaborate ondigital content with other users. FIG. 1C illustrates thesecollaboration selections 114A through 114D. Collaboration is describedmore fully below, but briefly, FIG. 1C illustrates that some selectionsfor using collaboration can include, but are not limited to, (1)highlight a portion for comment to existing collaboration 114A; (2)insert copy of file into existing collaboration 114B; (3) highlight aportion for comment in new collaboration 114C; or (4) insert copy offile into new collaboration 114D.

Multimedia selection 104C changes the action menu area 101B to includeselections relating to creating, playing, or otherwise managing multimedia content. Store selection 104D allows a user to save digitalcontent to local or remote storage. Both selections for handlingmultimedia 104C and storing digital content 104D can include selectionsthat are well known in the art and will not be discussed in greaterdetail herein. It will be appreciated that the various selections 104Athrough 104D in action menu area 101B may be modified depending onsystem design configurations.

Finally, FIG. 1A illustrates organizing area 101C which allows a user toview digital content stored on or otherwise accessed by the universaldigital content system in various different screens. These screensinclude, but are not limited to, a global inbox screen 106A, contactinformation screen 106B, organizational information screen 106C,documents screen 106D, messaging screen 106E, image files screen 106F,audio files screen 106G, video files screen 106H, and the like.

The global inbox screen 106A is used to combine and organize any digitalcontent that the user can access using the universal digital contentsystem. The global inbox screen 106A contains global selections 107Athrough 107E indicating broad categories by which digital content can beorganized including, but not limited to, messages 107A, contact view107B, date 107C, type 107D, and conversations 107E. The user can alsoselect a user messaging profile 107F. Generally, selections 107A through107F apply across all digital content files whereas screens 106B through106H provide more focused ways of organizing digital content.

With reference to global messaging view 107A, the universal digitalcontent system provides a single interface for accessing messagesreceived from different messaging platforms such as, but not limited to,instant message files, email message files, text message files, andvoice message files, and the like. Generally, when a user selects globalmessaging view 107A, the organizing area 101C changes to display thatall of the messaging digital content files may be grouped together andorganized under broad date categories, with the most recent messagingdata files received being listed first since a user is most likely toview newer messages first.

In another embodiment, the messaging digital content files can beorganized into broad messaging categories such as, but not limited to,instant messages, email messages, text messages, voice messages, and thelike. This embodiment can be considered a subset of global file view107D, since messaging digital content files are simply some of the typesof digital content that can be accessed by the user. Thus, thisembodiment will be described in further detail below with reference toglobal file view 107D and FIG. 2A. However, an expand selection may beprovided in the global messaging view 107A to expand the display toreflect the global file view 107D to show all types of digital content.

When the user selects any of the displayed messages, the dynamic userinterface 100 accesses the appropriate functionality in universaldigital content system (described below) to allow the user to view themessage in viewing area 101A and/or hear the message. This may includeinterfacing the universal digital content system with audio hardwareand/or software to enable a user to listen to voice messages. Asdiscussed above, the viewing area 101A may change to display featuresspecific to the messaging platform (e.g., email, IM, text messaging,voice messaging). Viewing messages also allows a user to view attachmentas is conventionally done.

As shown in FIG. 2A, selecting global contact view 107B in global inboxscreen 106A causes the digital content stored or otherwise accessed byuniversal digital content system to be displayed in organizing area 101C based on the broad category of the author of the digital files. Thecontact information relating to each contact can be minimized using anicon (not shown) so as to simplify the display. The digital contentrelating to each contact can be sorted by any criteria such as, but notlimited to, date, type, conversation, subject, and the like. FIG. 2Awill be described in further detail with regard to contact viewingscreen 106B.

Global date view 107C allows a user to sort all of their digital contentunder the broad category of date. This feature is somewhat illustratedin FIGS. 2A and 2B. However, whereas FIG. 2A relates to organizing bycontact and conversation FIG. 2B relates to organizing by type, theglobal date view 107C groups all of the digital content together andorganizes it according to a date range.

As shown in FIG. 2B, selecting global file view 107D causes the digitalcontent stored by the universal digital content system to be organizedand displayed according to the broad category of type of digital contentsuch as, but not limited to, email messaging files, instant messagingfiles, text messaging files, voice messaging files, documents, imagefiles, audio files, sound files and movie files, and the like.

With regard to instant messages, typically IM messages are not storedduring the IM session. However, universal digital content system can logIM sessions and maintain them in storage for inclusion in the organizingfunctions of the present invention. Further, a user will be able to openand continue an IM session based off of a stored IM session, discussedbelow. Generally, because IM sessions occur over a span of time, theuniversal digital content system monitors the date and time at which anIM session begins and ends. Further, the universal digital contentsystem monitors for activity in the IM session and makes note ofextended periods of inactivity. In this manner, IM sessions can bedivided into one or more session periods, with each period being able tobe identified by a date and time range. This is illustrated in FIG. 2Bby IM period 119A and IM period 119B being displayed as distinct digitalfiles so that segments that belong together.

In the case where the digital content file was originally included as anattachment or collaboration referenced digital content, it will bedisplayed both within the message in which it was attached orreferenced. In addition, the attachment or collaboration referenceddigital content will also be displayed as a primary digital content fileunder the category type in which it falls. For example, assume an imagefile 121 is attached to an email message 123. The email message 123 willbe listed under the email messages category 125 indicating that theemail message contains an attachment. In addition, the image file 121will be displayed under the image files category 127 indicating that theimage file was originally attached in another message. However eventhough the image file 121 is displayed under the image file category,when a user selects on the image file 121, the universal digital contentsystem may first open the primary email message 123 first, allowing theuser access to the image file 121 that is attached. Alternatively,selection of the image file 121 could also directly open the image filefor viewing on viewing screen 102. Of course, when the image file 121 isopened, as discussed above, the viewing area 101A may change to displayadditional features related to viewing and/or managing image contentsuch as, but not limited to, editing, resizing, coloring, drawing toolsand the like.

Finally, in FIG. 2B, the digital content types which would most likelybe included in one embodiment of the global messaging view 107A areshown by bracket 128. Thus, in one embodiment, global messaging view107A can display a subset of digital content files that are shown in theglobal file view 107D.

Selecting global conversation view 107E will organize digital contentunder the broad category of conversation. As used herein, the term“conversation” is used to refer to digital content that is linked orotherwise connected. For example, digital content in an electronicmessage are linked and can be components of a conversation. Thus, aconversation may show the primary message in which an attachment isincluded and also the attachment itself as part of a conversation. Aconversation can also include any reply or forwarded messages related toa message. Further, a conversation can include linking created duringcollaboration or attachments. Collaboration will be described furtherbelow. However, generally, users can collaborate on a particular digitalcontent file (the referenced digital content file) and link thereferenced file into one or more collaboration messages. Thecollaboration messages will continue to save the link to the referencedfile so the collaboration message and referenced file are identified aspart of a conversation. It will be recognized that a conversation canthus be composed of one or more digital content files and one or morecontacts.

FIG. 2A somewhat illustrates the global conversation view 107E exceptthat FIG. 2A (which relates to the global contact view 107B) only showsconversations relating to one contact. In order to view allconversations for all contacts, the user would select on globalconversation view 107E. FIG. 2A illustrates that contact 117A has beeninvolved in conversations 113A, 113B, 113C. Each conversation 113A,113B, 113C can be expanded to show the digital content involved in theconversation.

Finally, a messaging profile selection 107F is provided to allow a userto specify when and how to receive messages. Because the user could beinundated with numerous messages at sometimes inconvenient times, a usercan specify the method of delivery of messages and times at whichcertain delivery methods will be available. A user can specify certaintime periods during which each type of messaging is available to receiveincoming messages. For example, messaging that requires a user togenerally be present at all times such as instant messaging can beforwarded to as email messages. In another example, a user may not beavailable during a meeting to receive voice messages and may rather havevoice messages translated to text messages or forwarded as email. Inaddition, a user could allow incoming messages from certain contacts tobe passed through a certain messaging platform (e.g., instant messaging)while notifications of messages from other contacts are withheld untilthe user accesses a message viewing selection 107A. The universaldigital content system would thus include a module which handles theuser's messaging profile, discussed below.

Having described the features of global inbox screen 106A, the otherscreens 106B through 106H will now be briefly described. Turning to FIG.1B, the contact screen 106B can include contact information for one ormore contacts 117A, 117B, 117C. The contact screen 106B can show thename, address, phone numbers, fax numbers, messaging addresses, and thelike, for each contact 117A through 117C. Contact information can beused as is conventionally done to locate a contact. An icon 110 or otherindication (such as graying or highlighting the area around certaincontacts) can be used to indicate the network status of the contacts.Network status can include whether a recipient is online, offline,connected via a wireless or mobile device, idle, online but unavailable(e.g., idle or away), and the like. For example, an icon indicating aface with a smile can be used to indicate that a contact is online whilean icon having a face with a frown can mean that the contact is offline.When a contact is offline, a user may be prevented from sending aninstant message to the user. In another embodiment, the user's messagingprofile may be configured to automatically send messages by email aseither an email attachment or as inline text in an email message when auser is prevented from sending an instant message to a contact.

In addition, messaging information stored for each contact can be usedto assist in delivering messages to a contact. Exemplarily, when a userdecides send a message, the user can select or highlight one of thecontacts, as indicated by the dashed line 108 surrounding the contactnamed Jim Anderson. All necessary address information (e.g., emailaddress, mobile phone number) is automatically provided and no otherinformation need be provided from the user unless the user desires tosend the message to more contacts.

In contact screen 106B, an expand indicator (e.g., the + and − signs)next to each contact 117A, 117B, 117C can convert the view of FIG. 1B toshow the digital content that each contact 117A, 117B, 117C hasauthored, with FIG. 2A showing this expanded view. The expanded contactview in FIG. 2A also shows sort options 112A through 112C that allows auser to sort the digital content for each contact by file type, date orconversation. In the embodiment of FIG. 2A, the user has selected tosort the digital contact for contact 117A by conversations 112C.

Organizational information screen 106C is illustrated in FIG. 1C andselection of this screen displays various organizational informationselections 115A through 115D that display various types oforganizational information. A user can select calendar items 115A,journal items 115B, note items 115C, task items 115D, and the like.

Documents screen 106D displays all of the word processing files and canallow a user to sort these files by date, author, subject, and the like.

Messaging screen 106E provides various ways of viewing messaging digitalcontent. For example, a global messaging view folder may be providedwhich provides substantially the same view as global messaging view107A. Messaging screen 106E may further provide sub-folders under theglobal messaging view folder for each particular digital content typesuch as, but not limited to, instant messaging folder, email messagingfolder, text messaging folder, and voice messaging folder, and the like.Messaging screen 106E may also include other various folders that can beincluded in messaging such as draft folder, sent folder, delete folder,pending folder for potential spam messages, archive folder, and thelike.

Image files screen 106F, audio files screen 106G, and video files screen106H display all of the image files, audio files, video file, in theirrespective groups and can allow a user to sort these files by date,author, subject, and the like. Other ways of displaying digital contentthat a user can access through the universal digital content system maybe provided according to the teachings of the present invention and canbe viewed, organized, or sorted according to various criteria includingthe ones discussed herein or those understood by those of skill in theart.

It will be appreciated that while the main organizing views describedabove attempt to organize the digital content stored or otherwiseaccessed by universal digital content system to make finding digitalcontent easier for a user, the main organizing views can implementingfurther organizing or sorting features to assist a user in furtherorganizing or sorting the displayed digital content. For example, asshown in FIG. 2A (the global contact view 107B), the main organizingview is based on contacts, yet the digital content can further beorganized according to the file type for each digital content, date ofeach digital content file, or conversation with which the digitalcontent is associated. In FIG. 2B (the global file view 107D), the mainorganizing view is based on file type, yet the digital content canfurther be organized according to date received. Other sorting criteriaare also possible such as, but not limited to, author, date created,date received, date sent, subject, title, conversation, existence ofattachment, other contacts, and the like.

Now that the details of dynamic user interface 100 have been more fullydescribed, collaboration features will now be described. Collaborationallows one or more collaborators (i.e., contacts, including the user) tocollaborate with regard to one or more digital content files. Thisallows collaborators to comment on one or more referenced digitalcontent files, make edits, and the like. With reference to FIGS. 1B and1C, the dynamic user interface 100 facilitates collaboration.

A user can select to perform collaboration in a few ways. One way is toselect the collaboration selection 104B or 105E in the action menu 101B.Alternatively, formatting selections 103 can be provided with thisfeature or can be contained in a pull down menu in one of the formattingselections. In yet another embodiment, as shown in FIG. 1B, the user canaccess a digital file in viewing area 101A or organizing area 101C andright-clicking on their mouse which causes a pop-up menu 132 to appearcontaining an option for collaboration.

When viewing the digital file in the viewing area 101A, assuming thatthe user wants to collaborate on the email displayed in FIG. 1B, theuser can then highlight a portion of the digital content file (e.g.,text, images, sound icon, video or other digital content), as shown bydashed line 130. A user can then select “collaboration” using one of thevarious ways described above. When viewing the digital file in theorganizing area 101C, as shown in FIG. 2B, the user can right click onhighlight a digital content file and select “collaboration.” using oneof the ways described above.

When “collaboration” is selected using one of the ways described above,various selections 114A through 114D are provided as shown in FIG. 1C inthe action menu area 101B (and also shown in pop-up menu 132).Selections include (1) highlight a portion for comment to existingcollaboration 114A; (2) insert copy of file into existing collaboration114B; (3) highlight a portion for comment in new collaboration 114C; or(4) insert copy of file into new collaboration 114D. The user can thusselect to highlight a portion of the digital content file (selections114A, 114C) or to have the digital content file included as anattachment (selections 114B, 114D). Further, the user can have more thanone collaboration session operating at the same time. Thus, the user canselect to include the selected digital content file in an existingcollaboration (selections 114A, 114B) or in a new collaboration session(selections 114C, 114D). Similar selections are provided in the pulldown menus shown in FIGS. 1B and 2B.

In FIG. 1B, the user has highlighted a portion 130 of the email,hereinafter referred to as the referenced digital content file, to beincluded in a new collaboration. In FIG. 1C, the dynamic user interface100 changes to display the highlighted portion 130 in collaborationscreen 102A. In addition, FIG. 1C has a viewing screen 102E fordisplaying the referenced digital content file. The user can comment onthe referenced file directly in viewing screen 102E, such as commonlydone for email or text messaging. Alternatively, the user can selectinstant messaging in the delivery mechanism selections 105A through 105Gand an input screen 102C can appear to allow a user to input a commentwith regard to the referenced file. Thus, a user can select any deliverymechanism for sending the collaboration message to collaborators.Because collaboration implies sending a message to another collaboratorto exchange ideas, in one embodiment, selection of one of the“collaboration” selections 114A through 114D (FIG. 1C) in action menuarea 101B automatically refreshes to display delivery mechanismselections 105A-105G (FIG. 1B) to enable a user to select any one of thedelivery mechanisms.

In one embodiment, the collaboration settings in a user's messagingprofile can be configured to always use instant messaging as thepreferred mode for collaborating if at least one other collaborator isonline. In this mode, the other offline collaborators can view thecollaboration thread as email messages when they later access one of thecollaboration sessions. This is one example of how the universal digitalcontent system allows seamless transitions from different messagingcapabilities. For example, one of the offline collaborators who is notable to participate can come online, access a collaboration message viaemail and select “collaboration” through one of the various waysdiscussed above, and continue a collaboration session via instantmessaging. In fact, because the universal digital content systemcombines various messaging applications together and accessible by onedynamic user interface, the delivery mechanisms 105 can be described asvarious messaging modes. For example, instant messaging can be used tosupport “urgent” messaging. Email can be used to support “silent”messaging.

FIG. 1C illustrates an embodiment where the collaboration session isoccurring via instant messaging. Viewing screen 102A shows a threadedcollaboration conversation between multiple collaborators and involvingmultiple referenced files, the referenced files being shown in viewingscreens 102E, 102F. A graphic 134 may be used for each collaborator sothat a user can visually see the identity and number of collaboratorsinvolved in a collaborating session.

Each viewing screen 102A, 102E, 102F can include an indicator 102G,102H, 102I, respectively that indicates whether the viewing screencorresponds to a collaboration message or to a referenced digitalcontent file. Instead of showing multiple viewing screens 102A, 102E,102F for displaying each referenced digital content file, only oneviewing screen 102A, 102E or 102F may be displayed at a time and an areamay be displayed which shows icons 139, 140, 142 that graphicallyrepresent the collaboration file, first referenced file and secondreferenced file, respectively. The user can select on any of the icons139, 140, 142 to maximize the viewing screen for that digital contentfile.

FIG. 1C illustrates that multiple collaborators can make comments on oneor more referenced digital content files links 136A, 136B and 136C. Theuniversal digital content system maintains links between the links 136A,136B and 136C and the respective digital content files to which theycorrespond. In one embodiment, link 136A refers to highlighted portion130 in viewing screen 102E, link 136B refers to highlighted portion 131in viewing screen 102E, and link 136C refers to digital content fileshown in viewing screen 102F with no highlighted portion beingreferenced in this last digital content file. This illustrates thatlinks 136A, 136B and 136C do not necessarily need to be located on thesame digital content file or, if they are located in the same digitalcontent file, in any particular order in the digital content file.

When the user selects a link 136A, 136B or 136C, viewing area 101Achanges to bring the viewing screen 102E or 102F corresponding to theselected link on top of the other viewing screens. Further, if a link136 is a highlighted portion of the referenced digital content, theviewing area 101A will locate and display the portion of the referenceddigital content that was highlighted. This greatly facilitates theuser's collaborating effort.

In one embodiment, referenced digital files are included with eachthread of a collaboration session. Thus, if a collaboration messagereferences two different digital content files, both digital contentfiles will be included as attachments to the collaboration message sothat other collaborators who might not have the referenced documents canview them. In addition, the collaboration message tracks the location oflinks 136A, 136B, 136C so that each collaborator has a consistent viewof the collaboration conversation. Alternatively, selecting instantcollaboration 104B or 105E creates a shared storage area in a server towhich all the collaborators have access so that a separate copy of thereferenced digital content files do not need to be sent with each threadof the conversation.

Further, whether the referenced digital content file is included as anattachment or shared link, it will be displayed in organizing viewingarea 101C as an attachment to the collaboration message to which itcorresponds. The user will then have access to the referenced digitalcontent file by selecting on the attachment to the collaborationmessage. In addition, for example, in the global file view 107D, thereferenced digital content will show up under its appropriate categoryso that if a user desires to discover which conversations involved aparticular referenced digital content, they can locate it using, forexample, global file view 102D, which will display an indicator as towhat conversation involved this particular referenced digital content.The user can select on the conversation indicator and review theconversation that occurred with regard to this particular referenceddigital content as well as any other digital content file that wasinvolved in the conversation.

Further each collaborator will be able to make edits to a referenceddigital file. When edits are made to a referenced digital file, the link136 can display both the previous version and the edited version withinthe collaboration message. In addition, the edits can be viewed in boththe original version and the edited version when the user accesses thereferenced digital content file. Finally, an author of a referenceddigital file may prevent other collaborators from making edits to thefile.

Turning now to FIG. 3, an exemplary network configuration 200 providedby way of explanation and not limitation. System 200 includes a userdevice 201. User device 201 may include, but is not limited to, apersonal computer, a hand-held computer, a laptop computer, a mobilephone, an organizational information assistant, and the like. Device 201includes a hardware and software configuration that combine to formuniversal digital content system indicated by reference numeral 202. Auser can input digital content into universal digital content systemusing any of various input devices 203 including, but not limited to, akeyboard, a mouse, a stylus or other pointer (where the viewing screenis pressure sensitive), a joystick, audio hardware and software (e.g.,microphone), and imaging hardware and software (e.g., camera hardwareand/or software), and the like, whether directly or remotely connected.

Universal digital content system 202 includes a user interface 204. Userinterface 204 provides the features described above for the dynamic userinterface 100. In this embodiment, the user interface 204 communicateswith a plurality of action modules including, but not limited to, ainstant messaging module 206A, an email messaging module 206B, an textmessaging module 206C, a voice messaging module 206D, an instantcollaboration module 206E, an organizational information module 206F,and a storage module 206G. Each of modules 206A through 206G initiatesapplications 208A through 208G that correspond with each of the actionmodules 206A through 206G. Exemplarily, applications 208A through 208Ginclude a instant messaging application 208A, an email messagingapplication 208B, a text messaging application 208C, a voice messagingapplication 208D, an instant collaboration application 208E, anorganizational information application 208F, and a storage application208G. It will be appreciated that any number of existing orfuture-developed action modules 206 and corresponding applications 208may be implemented as necessary in view of the teachings of the presentinvention. Applications 208A through 208G can be found in the samesoftware application or in different software applications.

The user is thus able to select one or more of the delivery mechanismselections 105A through 105G (FIG. 1B) to initiate action modules 206Athrough 206G to perform a particular action on the text document createdthrough the user interface 204. The user interface 204 also communicateswith at least some of the action modules 206A through 206G to provideinformation in the organizing area 101C of dynamic user interface 100,such as for contact screen 106B and organizing information screen 106C.Further detail regarding how universal digital content system 202 canperform these acitons exemplified are described in co-pending U.S.patent application Ser. No. 11/005,348, filed Dec. 6, 2004, and entitled“Selection of Delivery Mechanism for Text-based Document, whichapplication is incorporated herein by reference in its entirety. Amessaging profile module 207 is provided to allow a user to select andmanage restrictions for sending and/or receiving messages throughuniversal digital content system 202.

Voice module 206D includes a translator module 215 for translating audioto text or vice versa for both sending and receiving messages. Forexample, if a user's messaging profile indicates that the user desiresto receive all voice messages in another format (e.g., email, instantmessage, text message), when an incoming message arrives at user device201, translator module 215 will convert the audio message to a textformat so that the user can access the message under the desired messagecategory using dynamic user interface 100.

It is also possible for the universal digital content system 202 to bebifurcated so that a portion indicated by reference numeral 211 islocated on user device 201 while the remaining components of universaldigital content system 202 are located elsewhere, e.g., a remote serverin network 216 with which the user device 201 communicates. For example,to minimize the footprint of universal digital content system 202 on auser's mobile phone, portion 211 could be located on the user's mobilephone and communicate with a server to provide the additionalfunctionality of the universal digital content system 202.

As shown in FIG. 3, each of action applications 208A through 208G canaccess a database 212. While the database 212 is shown as a singleentity, it will be appreciated that the database 212 may include one ormore storage devices, remote or local, to which the user device 201 hasaccess. In addition, it is possible for each action application 208Athrough 208G to access different databases. However, database 212 isillustrated simply to show that the action applications 208A through208G are able to access some type of database. The database 212 canstore information relating to all digital content files created and/oraccessed by universal digital content system 202 so that the digitalcontent files can later be accessed.

In some embodiments, the user interface 204 can access an existing wordprocessing, imaging, and/or audio-visual application 214 residing on theuser device 201 or on a server in network 216. This can help to minimizethe amount of code required to develop the user interface 204. It willbe appreciated, however, that universal digital content system 202 doesnot have to access an existing word processing, imaging, and/oraudio-visual application residing on the user's device, but could have asystem-specific word processing, imaging, and/or audio-visualapplication integrated into universal digital content system 202.

Some of the action applications 208A through 208D allow a user totransmit a message to one or more recipients. Thus, FIG. 3 alsoillustrates an exemplary network configuration. The user device 201communicates with a network 216, which can include one or more servers.The network 216 also communicates with one or more recipient devices218. Similar to the user device, the recipient devices 218 can include,but are not limited to, a personal computer, a hand-held computer, alaptop computer, a mobile phone, an organizational informationassistant, and the like.

Thus, the universal digital content system provides several benefits.First, the universal digital content system eliminates the need for auser to navigate through one or more digital content applications inorder to find the correct application to manage a digital content fileor to perform a delivery function with regard to the digital contentfile. Second, universal digital content system allows a user to changethe action mid-stream without having to access a different application.Third, the universal digital content system allows a user to performmultiple actions on a particular text document. Fourth, the universaldigital content system allows users to control message delivery andnotification selections at a single source. Fifth, the universal digitalcontent system provides a common interface for organizing and accessingdigital content files stored locally or otherwise accessible byuniversal digital content system. And finally, the universal digitalcontent system allows collaboration between multiple collaborators andusing multiple digital content files.

The embodiments of the present invention may comprise a special purposeor general-purpose computer including various computer hardware.Embodiments within the scope of the present invention also includecomputer-readable media for carrying or having computer-executableinstructions or data structures stored thereon. Such computer-readablemedia can be any available media that can be accessed by a generalpurpose or special purpose computer. By way of example, and notlimitation, such computer-readable media can comprise RAM, ROM, EEPROM,CD-ROM or other optical disk storage, magnetic disk storage or othermagnetic storage devices, or any other medium which can be used to carryor store desired program code means in the form of computer-executableinstructions or data structures and which can be accessed by a generalpurpose or special purpose computer. When information is transferred orprovided over a network or another communications connection (eitherhardwired, wireless, or a combination of hardwired or wireless) to acomputer, the computer properly views the connection as acomputer-readable medium. Thus, any such connection is properly termed acomputer-readable medium. Combinations of the above should also beincluded within the scope of computer-readable media.Computer-executable instructions comprise, for example, instructions anddata which cause a general purpose computer, special purpose computer,or special purpose processing device to perform a certain function orgroup of functions.

The following discussion is intended to provide a brief, generaldescription of a suitable computing environment in which the inventionmay be implemented. Although not required, the invention has beendescribed in the general context of computer-executable instructions,such as program modules, being executed by computers in networkenvironments. Generally, program modules include routines, programs,objects, components, data structures, etc. that perform particularactions or implement particular abstract data types. Computer-executableinstructions, associated data structures, and program modules representexamples of the program code means for executing steps of the methodsdisclosed herein. The particular sequence of such executableinstructions or associated data structures represents examples ofcorresponding acts for implementing the functions described in suchsteps.

Those skilled in the art will appreciate that the invention may bepracticed in network computing environments with many types of computersystem configurations, including personal computers, hand-held devices,multi-processor systems, microprocessor-based or programmable consumerelectronics, network PCs, minicomputers, mainframe computers, and thelike. The invention may also be practiced in distributed computingenvironments where actions are performed by local and remote processingdevices that are linked (either by hardwired links, wireless links, orby a combination of hardwired or wireless links) through acommunications network. In a distributed computing environment, programmodules may be located in both local and remote memory storage devices.

The present invention may be embodied in other specific forms withoutdeparting from its spirit or essential characteristics. The describedembodiments are to be considered in all respects only as illustrativeand not restrictive. The scope of the invention is, therefore, indicatedby the appended claims rather than by the foregoing description. Allchanges which come within the meaning and range of equivalency of theclaims are to be embraced within their scope.

1. A system comprising: a computer configured to display a userinterface, the user interface being configured to: display acollaboration in a first window; display an email in a second window,the email including: a header; and a body; display an instant message ina third window; receive first user input selecting first text of thebody of the email displayed in the second window; receive second userinput indicating that the selected first text should be added to thecollaboration displayed in the first window; in response to receivingthe second user input indicating that the selected first text should beadded to the collaboration displayed in the first window: add, to thecollaboration displayed in the first window, a first user-selectablelink including the selected first text from the body of the email;receive third user input selecting second text of the instant messagedisplayed in the third window; receive fourth user input indicating thatthe selected second text should be added to the collaboration displayedin the first window; and in response to receiving the fourth user inputindicating that the selected second text should be added to thecollaboration displayed in the first window: add, to the collaborationdisplayed in the first window, a second user-selectable link includingthe selected second text from the instant message. 2.-21. (canceled)